Controlling Error in Multiple Comparisons, with Examples from State-to-State Differences in Educational Achievement

نویسنده

  • Valerie S. L. Williams
چکیده

Three alternative procedures to adjust significance levels for multiplicity are the traditional Bonferroni technique, a sequential Bonferroni technique developed by Hochberg (1988), and a sequential approach for controlling the false discovery rate proposed by Benjamini and Hochberg (1995). These procedures are illustrated and compared using examples from the National Assessment of Educational Progress (NAEP). A prominent advantage of the Benjamini and Hochberg (B-H) procedure, as demonstrated in these examples, is the greater invariance of statistical significance for given comparisons over alternative family sizes. Simulation studies show that all three procedures maintain a false discovery rate bounded above, often grossly, by ct (or c~/2). For both uncorrelated and pairwise families o f comparisons, the B-H technique is shown to have greater power than the Hochberg or Bonferroni procedures, and its power remains relatively stable as the number of comparisons becomes large, giving it an increasing advantage when many comparisons are involved. We recommend that results from NAEP State Assessments be reported using the B-H technique rather than the Bonferroni procedure.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Current state of professional and core competency in pediatric residency program at Shiraz University of Medical Sciences: A local survey

Introduction: Accreditation assesses performance, or capacity toperform, against predetermined standards. It typically combinesexternal quality assurance, through a process of peers review,with elements of self-regulation through internal and selfdirectedassessment. This study is an attempt to identify thequality of pediatrics residency educational programs regardingpredetermined standards.Meth...

متن کامل

Brain Activity Map Extraction from Multiple Sclerosis Patients Using Resting-State fMRI Data Based on Amplitude of Low Frequency Fluctuations and Regional Homogeneity Analysis

Introduction: Multiple Sclerosis (MS) is the most common non-traumatic neurological diseases of young adults. MS often reported during ages 20-62. MS affects the various anatomical parts of the central nervous system. Up to 65% of multiple sclerosis patients MS patients suffer from various problems, such as fatigue, depression, pain and sleep disorders. Unlike MRI, that only sh...

متن کامل

Comparative Analysis of the Kurdish Problem in Turkey and the Issue of Chinese in Malaysia within the Context of Nation-State and Ethnic Differences: Advantages and Disadvantages in terms of Turkey

In this study, the ethnic problems which are one of the most significant and perhaps the primary structural difficulties and problems of the nation-state and possible solutions will be suggested. Even if it starts with the general information, the focus of this study would be the subject matter which is known as the Southeastern Problem in Turkey yet it has started to be mentioned as the Kurdis...

متن کامل

The effects of misclassification errors on multiple deferred state attribute sampling plan

Multiple deferred state (MDS) sampling plan by attribute in which current lot and future lots information is utilised on sentencing submitted lot, is constructed under the assumption of perfect inspection. But sometimes the inspection may not be free of inspection errors. In this paper, we develop MDS-plan by attribute to the state where misclassification errors exist during the inspection. In ...

متن کامل

The Effect of Neuropsychological Rehabilitation on the Improvement of Cognitive Function related to Accuracy and Attention in Military Shooters with Moderating Effect of Organism Constraint

Background and Aim: The development of functional promotion methods in military tactics, especially shooting, is essential for the military. The aim of this study was to investigate the effect of neuropsychological rehabilitation on the improvement of cognitive function related to accuracy and attention in military shooters with moderating effect of organism constraint. Methods: The current stu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1999